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ABSTRACT 

^ To test the efficacy of variables found effective hw> 
regular classrooms ,(in previous process-product research), variables 
were observed, for^ 12&> elementary school children in 17 resource 
classrooms. Measurement of teacher structure and student achievement 
was performed. Results indicated .that , although most of the variables 
wece used .to at least a moderate, degree" in most classrooms, only the 
frequency with which students responded correctly consistently 
predicted performance (pn reading achievement measures. In contrast to 
regular' settings, in which it has been suggested that a level of 
success that is too high may decrease student motivation, the study 
indicated, that the higher the rate of correct^ answers the better the 
results in terms of* achievement. Findings' provided a caution- in the 
generalization of process-product research to\special education. 
( Author /CL) .« , * 
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) Abstract 
• Process-product * research has t^een successful in '-identifying 
effective teaching variables i'h the regular classroom; little research 
in th^s area has'been done with students in special settings, however, 
In order .to test the efficacy of ^variables previously found effective 
in regular classrooms, a number of * the^se Variables were observed for 
126 elementary schools children in 17 resource, classrooms. Results 
i plicated that, although most of the variables were used to at Jeast a 
moderate degree in most classrooms, only the frequency with, which 
.students responded s corr^tly consistently predicted, performance on 
reading achievement measures. * Implications '-for further process- 

•product research in special classrooms are discussed. 
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Ihe Non-Effect of Process-Product Variables in 
* » . * 

Resource Classrooms .■ 
In the past two decades, the observational- study of teaching has 
produced significant gains in identifying teaching * strategies, and 
•behaviors that are effective in promoting student achievement (Bloom, 
1980).. Correlating* data obtained .from direct observation of classroom 
teaching with student outcomes, process-product studies have isolated 
a.. number of, teaching variables that consistently bear a positive 
relationship to student achievement (Stevens & Rosenshine, 1981). At 
a time 'when the effectiveness of public education is being seriously 
called into question (National Commission on Excellence in Education, 
1983), t these new findings offer the possibility of more effective 
classroom management and teaching strategies. 



* Comparisons 'of both effective and ineffective teachers (Good & 
Grouws, 1977) and high and low achieving, schools (Frederick, 1977) 

jrevea'ted x that student learning is most facilitated in classrooms with 
a- high degree ; of structure and teacher-directed activities. In- a 

'study of ^second and fifth grade classrooms, the Beginning Teacher 
Evaluation Study (Fisher, Berliner, Fi 1 by, Marliave,, Cahen, & Dishaw, 
1980) found that both the amount of time allocated ^to student 
instruction by the teacher, and the proportion of that time the 
sludent was actively 'engaged in learning correlated positively with 
student performance on achievement tests. Stall ings ('1975) reported 
strong relationships between a * number of measures af academic 

engagement and Student achievement. In a review of observational 

t * ' ' ' 

cj ass room research, Stevens and Rosenshine (1981) concluded that. 

/ - 

teachers -who have proven more successful in promoting learning gains 
"have been/those most in control of the learning process: • 



that is; they selected and directed the academic activities, 
approached the subject matter in a direct businesslike way, • 
organized learning around questions they posed, and occupied 
the c eater of attention. In contrast, the less successful 
teachers- made the students the center of attention, 
organized learning around the students 1 own questions, and 
joined 'or participated in students 1 activities . .(p. 2) 

The characteristics of the instruction that 'students receive also 

have been explored in relation to academic outcomes. r instructing 

teachers to demonstrate skills to be learned, guide and prompt the 

students as they are- learning the skills, and provide time- for 

independent practice produced significant performance improvements 

among 'students (Good & Grouws, 1977). Such controlled practice may be 

J • £i. 

most effective when it consists primarily of factual si ngle-'an?wer 
questions* (Soar, 1&73). and is accompanied by frequent teacher feedback 
concerning the correctness of responses (Anderson, Evertson, & Brophy, 
1979; Fisher et all"/ 1980). 

Practice' has beeo found to be most beneficial when it is related 
directly to the subject-matter and allows- the student to experience 
moderate to' high rate of success. Thus,' Leinhardt, Zigmond, and 

r 

Cool ay (1980) reported that silent practice in reading correlated most 

strongly with reading achievement for resource room students; 

StalHngs. (1975) found similar results for both oral and silent 

practice. One of the more important findings of the Beginning Teacher 

Evaluation .Study was that material that allows the student to 

experience a moderate, to high, rate of 'correct answers, is most' 

beneficial in promoting learning among elementary school children 

(Fisher et al . , 1930). 

Other characteristics of lesson presentation also, may influence 
student achievement. Kounin ,(1970) first identified the importance of 
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smoothness and momentum in effective teaching. The importance of a 
brisk instructional pace has received some empirical support. . Both 
Stallings (1975) and Anderson et al. (1979) reported ■ that the 
frequency of academic interactions/per minute related significantly to 
.b'oth reading and math ^achievement. In addition, the % more 
individualized instruction is, the more effective it, has been found to ' 
be in promoting student academic achievement (Glass & Smith, 1978; 
Stevens &■ Rosenshine, 1981),. : 

WhUe .'many of. the above 'findings are based primarily on 
correlational, studies, a large body of [experimental evidence supports 
the effectiveness of reinforcement, especially tok^n systems, in 
special classrooms.' Token economies have been" implemented in a 
variety of settings, and have been ' found ef/e^tiVe ^in decreasing 
disruptive behavior and shaping appropriate 1 behavVor^across a wide 
range of populations (Kazdin, 1977; O'Leary & Drabman, 1971), c :Jn a 
quantitative 'synthesis of 5000 studies, Lysakowsk.i and. Walberg (1981) 
found* the general effect of reinforcement on classroom learning to be 
"moderately large and fairly robust," and especial ty effective in 
special educat i on % settings , ' Specific studies utilizing social 
reinfofxers such as* praise have pro^duc^d more inconsistent results, 
however, in some. Vases correlating 'negatively with achievement test 
results (Good & Grouws, 1977), Brophy (1981) argued that teacher 
praise does not al ways^f und.tion as a reinforcer, and that further 
study is necessary to determine its effectiveness". 

Although it has achieved ' some success in describing effective' 
teaching, process-product research has yet to resolve a number of 

8 
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methodological problems. ' Thus -far, the investigations have been 
primarily correlational, providing no evidence concerning the 
direction of causation (Good & Grouws, 1977); and attempts to' study 
the observed variables experimental ly ' have met with only modest 
success (Anderson et al., 1979). In addition, process-product 
research thus far /has rel ied primari ly on standardized achievement 
tests for its dependent measures, and the rel i abi 1 i ty, ' val idi ty and 
^standardization of such measures ms often suspect (Salvia & Ysseldyke, 
1981). The large majority of such st/jdies have examined only teachers 
and student's in regular classrooms, and those th-at have attempted to 
apply the findings to special populations have not alv/ays -repl icated 
the results (Thurlow, Graden, Greener, & Ysseldyke, 1982). In fact, a 
large proportipn of the observational instruments used in process- 
product research have failed to provide results general izabl e over 
time anddassrooms, even within regular classroom settings (Shavelson 
& Dempsey-Atwood, 1976). Finally, sinqe cognitive entry variables are 
estimated to account for up to 60% of post-test achievement ' variance, 
the correlations between teaching behaviors ■ and student, outcomes have 
been relatively small, typically accounting for only 8% to. 15% of the 
variance (Borg, 1980). 

The purpose of the current * study was to. investigate the usage and 
effectiveness of specific teaching behaviors in the resource '-room 
setting. Th^ degree to which such strategies were implemented in 
resource classroom settings, as well as the stability of such teaching 
behaviors over time was investigated. Finally, the relationship of 
the variables identified through process-product research to student 
achievement in special 'education classrooms was explored. ' 



' • Method • . 

Subjects , , , / v 

The .subjects for all statistical analyses weVe 126 grade 1-8 
resource room students in^four rural and suburban Minnesota school' 
districts. All subjects were- ' participants in research- on the 
effectiveness of direct and frequent curriculum-based measurement and 
evaluation system. Of , the 126 ^students, .99 were receiving the 
experimental treatment, while, 27- were 4 not receiving data-based 
services. The distribution of students by grade is presented in Table 
1; the mean age was 9.5. The sample included 105 boys and 21 girls. 
The 35 teachers participating in the study had spent a mean of 2.0$ 
years teaching regular education and 4.89 years teaching special 
education. 



Insert Table 1 'about here 
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< . * """^ -! , * 

Measures " 

* Three, measures were used- to colject data: one for structure, and 

two for achievements The structure of ^the individual student ! s 

instruction was assessed by means *of .the Structure of Instruction 

Rating Scale (bend, King, Skiba, Sevcik,. & Wesson, 1983) . Achievement 

measures included timed / samples from three third grade passages (Deno, 

Mirkin, Chiafig, & Lowry, 1980), and four subtests of the Stanford 

Diagnostic Reading Test (SDRT). ' 

Achievement measures . At three different points in "time during 

j 

the study, three one-mfnute oral reading measures, consisting of 

• * 
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randorp^ -selected* passages from the third grade level in Ginn 720, 

were'administered to the students. These measures were selected based 

i • 
on their technical adequacy (Deno et* al., 1980) and sensitivity to 

change (Marston, Lpwry, Deno, & Mirkin, 1981). 'These curriculum-based 

^^^^ 

measures had been found to be as reliable and valid as traditional 

standardized tests, .yet more likely to reflect small increments of 

improvement. The measurements x were conducted by directing' students to 

begin; reading at the top of the page and continue re'adinq for one 

minute-, at which time the examiner would say stop. If they came to a' 

word they did not know, the examiner would supply the word and prompt 

them to continue. While the student was reading, the examiner 

followed along on a copy of the passage - and marked .errors of 

.substitution ? and. omission. Following the reading, the numbers of 

words read correct and incorrect were counted and recorded, with no 

feedback- given to the student. Thes£ v 'three reading measures -were 

given at the beginning of the study (pretest), in the middle, and 

( immed iately following the final observation (posttest). 

Two .subtests from the Stanford Diagnostic Reading Test (Karlsen, 

i 

Madden, & Gardner, 1976) f also were giveh as posttest measures. * The 

Structural ..Analysis and Reading Comprehension subtests were 

" . ~ ( 

administered along^with the final, reading passage measures. Each of 

£hese- subtests has. two parts , with Structural Analysis focusing on 

syl labication (blending and division) and Reading Comprehension 

focusing on answering both literal and inferential questions for 



previously read passages. 

Structure bf instruction rating scale (SIRS). The Structure of 
instruction Rating Scale (SIRS) was designed to measure the degree of 

• .11 . 



structure of the • instructional lesson that a student' received. The 
-selection. ( of variables for the instrument was. based on current 
research fr-ndings. The variables included in the SIRS, their 
operational definitions, end the rating scale format, are jncluded- 1 in 
Appendix A. The SIRS, as originally constitute/, included only the 
first 10<^TrTaB 1 es , and ~enly these variables were observed for the 
first data collection. The; . variables. Oral Practice and Silent 
Practice tfere added after the first data collection: , thus, the SIRS 
consisted of 12 variables for the second and^third data collections. 

Two rounds of pilot" data. were collected, analyzed, and refined to 
develop the y initial 10 variables, . It should.be noted that the 
operational definition .of the variable 'Positive Consequences did not 
include teacher praise,- ^Teacher praise was excluded because of 
evidence suggesting that the reinforcing value of teacher praise still' 
needs to be empirically validated (Brophy, 1981). 

The SIRS purposely 'was designed to focus -on the instruction a 

student receives, rather than focusing on the^ teacher. This approach. 

was taken -because it is possible, and even lifcejy, that the behaviors 

of a teacher toward a group of students may in fact be differentially 

effective with individual students. Since special education focuses 

on the individual, the, individual 'instructiona-T'. program was selected 

as '..he target for measurement rather than the teacher. 

The SIRS consists of 12 five-poijit rating Scales, A rating of 1 " 

is low for the variable and 5 is high., Observers, trained by 

t 

videotape to a criterion, of * .30-. 90 inter-rater agreement, rated all 
variables on the basis of strict definitions at the end of a 20-fninute 



observation period. For the current study," nine research assistants 
were ftrained as observers h and reached a mean inter-rater agreement 
level of .92 before actually observing' in the classroom. 

The reliability of the SIRS was assessed by means of Cronbach's 
alpha, a measure of internal consistency, as recommended by Haynes 
(1978). ' /or the"* three observation sessions, the -mean inter-item 
correlations were .33,^22, and .29, resulting in alphas of .84, .76, 
.and ' .81. Thus, the scale evidenced reliability both in terms of 
inter-observer agreement and internal consistency. Further details 
concerning rater .training and technical characteristics may be found 
elsewhere (Deno et al., 1983). ; . * - 

Procedures 

V 

Observers .jilted classrooms' three times during the course cf the 
year: in November, soori after the implementation of the experimental 
•treatment, in' February, and:-in May, at the end of the school year. 
Raters were instructed to observe the individual student for 20 
minutes and then make their ratings. Although directed not to rate 
during the observation, so as to ensure a more global rating, raters 
were encouraged to refer . to' the .operational definitions to provide a 
•structure for the observation. • 

Reading passage data also were collected three times, during the 
year, .within two weeks of'each observation. The Stanford Diagnostic 
Reading Test was administered' as a post-test in May. 
Pes ign . * ... 

Stability of teacher behaviors 1 was assessed by correlating each 
variable on the SIRS across observation sessions. Such estimates 

' is ;•" , 



■' 9. 
provided not only an estimate of the stability of teaching behavior, 

but also, an estimat&^of the consistency of the scale over time.' 

j Since teacher structuring behaviors had been found to be very 

stable across time for this population (Wesson, Deno, Mirkin, Sevcik, 

Skiba, King, Tindal , 4 Maruyama,, 1982), the results of the three 

observations were aggregated before examining- relationships with 

achievement. Such aggregation has been shown to increase stability 

and reduce measurement error (Gronlund, 1976)/ A series of regression 

■ ■ ' 
analyses then was performed using the achievement measures as 

dependent measures and the SIRS variables as independent variables. 

Since school achievement has been shown -to be correlatawnost highly 

with entering student ability (Bloom, 1976; Fisher et al., 1980), two 

J 

methods of controlling for achievement were used. w First, pretest 
achievement (as measured by passage data) was forced as the first 
independent variable for all regression analyses 'conducted on the 

i j 

scores obtained during the second and third data collections. Second, 
.two gain scores were calculated: a score representing the absolute 
gain in words read per minute between the' first and third timed 
passages, and the conversion of these absolute gain scores into 
percentage gain. Achievement was standardized by grade to control for 
age effects (except for gain scores, which were based on raw data); 
SIRS ratings were standardized by site to control for rater effects 
among s 1 tes . j 

Resul/ts 

Teacher Use of the SIRS Variables 

The^ means and standard deviations (see Table 2) indicated that 
t v he« behaviors represented by^the SIRS items are present in the 

14 



10 * ■ 

resource classrobms in varying degrees. Four of -the 

variables—Frequency or Correct Answers, Corrections, Teacher Directed 
Learning,, and Active 'Academic Responding—were consistently observ/d^ 
to a greater 'degree} as indicated by higher ratings. \Te*acher 
monitoring of independent practice, use ofvtoken econpmies,^aRd silent 
reading practice were more often. scored on the low end of ihe scale. 



-Insert Table 2 about here 



; • Correlations among the variables . Since alj SIRS items 

represented /behaviors meant to be - characteristic of effective 

teachers, one would expect some correlation among. the variables. Yet 

correlations that were too higVat any one observation session might 

evidence halo effects on the part r raters. Moderate correlations 

were obtained for the SIRS items at each observation time. 

Correlations ranged from -.26 to„ £76, with the majority in the .30' s 

and .40's. Three of the variables, Active Academic Responding, 

Teacher Directed Learning, and Pacing, consistently evidenced strong 

correlations with one another. 1 

Stabi 1 ity of the var i abl es over time . For the most part; the 

teacher 5 behaviors observed were fairly stable over time. Typical 

correlations between different observations of the same teacher 

behavior ranged from .27 to .45, the great majority being significant 

at p < .001. Of the 12 SIRS variables, only Controlled Practice (time 

* 7 
1 to' time 3) and Positive Consequences (time 2 to time 3), showed 

inter-session correlation not tote significant (at 'least jl> < .05). 

15 



Structure and Achievement 

Results of the regression of SIRS ■ variables on various 
achievement measures after cohtrol 1 i ng . f or entering achievement are 
presented in Table 3. The large proportion of variance accounted for, 
by enter>i ng achievement is typical of such studies , as is the 
relatively low proportion of residual variance explained by teacher 
variables (Bloom, 1976; Borg/ 1980). k " 

. -Insert Table 3 about here ^ 

i 

What differentiates these results from o.ther such studies is the 
failure of the majority of the variables to positively predict 
achievement. Not only was Frequency of Correct Answers the only 
variable to, achieve significant positive correlations with achievement* 
measures, it was also, the only variable to maintain a positive 
correlation with achievement ac\oss all measures. It also positively^ 
accounted for .the largest proportion of residual variance (ranging 
from 1% to .8%) on all measures except percent gain of words read 
correctly from third grade passages. 

A 1 though aggregati ng rati ngs over observations should decrease 
measurement error and -.increase rel iabil ity, ' there is also th.e chance 
that averaging across time will wash out^real differences in teaching 
behavior across time. Thus, multiple regression analyses of structure 
on achievement also were performed for ^fehe.-standardized data from the 
final data collection. The results proved very, similar, to the 
findings based on the aggregated data. Frequency of Correct" Answers 

IS 



12 • . 

-** 7 f 

was' again the only variable to, correlate consistently positively with 
achievement measures.^ In addition, .Corrections correlated 
significantly negatively -with both the third »grade reading passages 

(F=4.42, p=. 039)-, (and the overall SORT score (F=1.53 y p=.059)./ 

♦ 

Discussion ; ' ^ 

\ In the^ past 10 years, observational study of teaching has 
provided a number of, new insights concerning teaching. Techniques 

' A ~~ 

once * thought essential to effective - instruction, such as warmth or 

higher level instruct ion , have proven to be of gmly secondary 

1 <.\ \ j ^ v- \ 

importance in ^predicting student outcomes (Dynkin & Biddle, 1974). 

Perhaps mor-e important ly, the recent body of process-product research 

has provided strong evidence for the' importance of a highly structured 

learning environment in the regular classroom. U 

Still, generalizations from" the ^regular classroom to special 
education must be ftiade cautiously. Unless we assume that students 
referred to special settings are the product of poor teaching, it is 
evident' that, perhaps for the majority of special education students, 
techniques that are ordinarily effective have failed to achieve the 
desired-* results. One would expect then, that a different set of , 
conditions may be required to promote optimal student lsarninq in the 
resource room. - * \ 

Indeed, the different goals and conditions prevailing in special 
classrooms may make process-product research more difficult in such 
settings. The large, relatively homogeneous regular classroom tends 
to favor strategies that emphasize* efficiency, that is, those that 
provide effective instruction to the greatest. number of children. In 



a special setting, where class sizes are small and students with more 
intense learning or behavior disorders may require a ^unique approach, 

( / 

effective instruction may need to be studied on an individual basis. 
In fact, given our current state of knowledge in special education, we 

. \ 

do not know what will work with any g'iven student (Deno. & Mirkin, 

1977). Thus, each program for each individual student must be viewed 

.I 

as an "educational . experiment": -i> new techniques must be tried and 

• * 

monitored until successes achieved. 

Jhe results reported in this investigation do provide support for. 
the findings of Fisher et al . (1980) regarding the / importance of a 
high success rate in learning new skills. Of the 12 variables 
stud iledA only the frequency with 1 which the student gave correct 
answers correlated positively with measures of student achievement. 
Especially for students with a history of failure in the classroom, 
success in learning may be i/nportant in building the student's 
confidence in his/her own ability to do academic tasks. More simply, 
a high rat£ of success may act as a reinforcer that will* make future 
attempts, to learn more likely. 

t In contrast to regular' settings, in which' it has been suggested 
-ihat a level of^<?uccess that is too high may decrease student 
motivation (Fisher et al., 1980), the current findings are linear: 
the higher the rate of correct answers, the better the results in 
terms of achievement. Terrace (1963) introduced a similar idea in 
'■'errorless disprimination," and subsequent research has shown that 
menta 1 ly retarded subjects can be taught very complex tasks by 
initially providing a high degree of success on simpler tasks (Sidman 
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& Stoddard, 1967) . .. A. similar model in resource settings might suggest 

ttfat material that is almost • "too easy'V^ror the student might 

initially ibe preferable, in order to provide a high rate of success. 

Once the student' has "experienced learning - as • reinforcing, tf may be 

advisable to gradually introduce more challenging materials. ^ 

The current findings also provide a caution in the generalization 
\ * 

of process -product research to spec i al education. Several variables 

. • ' " ' * } 

on the SIRS evidenced no relationship, or even a si ightly negative 

relationship, to student outcomes. This may not, and likely does not, 

indicate that such variables are unimportant when working with special 

needs students. Results indicated that a number of the variables were 



used relatively widely across classrooms, ancj might differ in a- sample 
that utilized these- strategies to a lesser degree. What these 
findings ind]cate^)is that the qualities of. generally effective 
teaching might predict ^student achievement jn resource room settings 
only in conjunction with strategies specific to the resource room. 

Ratings on all 12 SIRS scales demonstrated stability across tim\ 
and rater. Rotation of observers over observation sess ions ensures, 

that such stability was more than just rater halo effect. These 

. ( 

resul ts are cons i stent with previous f i ndi ngs that h i gh inference 
coding systems such as^rating scales tend \to be more stable across 
time and situations (Shavelson & Dempsey-Atwood, 1976).- This does not 
necessarily argue for the superiority of high inference measurement, 
however. The stability of m such systems may in part be due to the more 
general nature pf category definitions; more precise and molecular 
coding categories might yield lower stabi 1 i.ty cor re Tat i ons (Haynes , 
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1973). /Further research simultaneously "using both high inference 
^systems and lSw inference coding schemes, such, as behavior counts, 
could provide a more def ini t ive answer concerning whether observed 
stability in cod'ing" systems- is merely a measurement artifact, or a 
function of the behavior itself. ' 

Research that seeks to demonstrate links between teacher arfd 
student behavior has already contributed greatly to~"oYir understanding* 
of the learning process, anci will doubtless continue to be of great 
importance. Identification of "alterable 1 ' teaching variables (Bloom, 
1980) may help provide guidelines in ,the remediation of learning and 
behavior disorders, especially if teachers can be trained easily to 
use such variables. Still, the present study argues that caution Js 
advised in attempting to generalize the findings of process-product 
literature to special settings. Given the relative recency of the 
research' methodology, and the complexity of resource classrooms," 

considerable study may be required before a definitive set of 

\ * 

effective teaching strategies can be positively identified. 

r 
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Grade. 



Table 1 

Breakdown of Subjects by Grade 

' r 

Percent of^ubjects " , 



1 

2 

3 

4 

5. 

6 

7 

8 



4.9 
17.9 
23.6 
23.6 

£q.3 

? 7.3 
1 .6 
.8 



/ 
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Table 2 

Means and Standard Deviations for the Aggregated SIRS Variables 3 ' 





f 

v 

A 


(SD) 




Instructional Group i ng 


✓ 3.59 
* 4.11 


(1.020) • 




Teacher Directed Learning 


(0.765) 1 




Active Academic Responding 


4.10 


(0.771 ) 




Demonstration and Prompting 


3.20 . 


' -(0.768t 




Controlled Practice 


3.70 


(0.898) 




Frequency of Correct Answers 


4.15 


(0.588) 




Independent -Practice ^ 


2.22 


(1 .067) 




Corrections 


4.23 


(0.747) 




Positive Consequences • 


1 .81 


(1.017) 




Pacing 


3.78 


(0.872) 




Oral Reading Practice 0 


3.02 


. (1 .'080) 




Silent Reading Practice" 


2.08 


(0.854) 





All scales are 5 point scales;' a rating of 1 represents low usage, 
a rating of 5 high usaae 

J N=88; for all other scales N=126. v 

Oral Reading Practice and Silent Reading Practice were observed only 
during the second and third observation sessions. The means for 
these variabl es represent aggregation over only two occasions. 

/ - ^ 
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Table 3 



, Summary of Regression of SIRS Variables on V f Achievement Measures (N = 89) 



0 



"Proportion of ' SllSlariables 
Variance Accounted with Significant 
for by Pretest Beta-weights- '. 
Achri ev.ement a : \(p, < ,1Q)b sign Variance 0 



Passage Score'- Time 2 

Passage 'Score - Jime 3 

SDRT. - Comprehension 
Subtests 

SDRT - Structural 
Analysis Subtests 



^DRT - Total Score 
'Passage Gain Score 
Percent Gain 



.68 
,54 
.07 

.23 

.17 



1 f ' 

Frequency of / * 
Correct Answers • 



Proportion of Residual Variance > 
Residual. • Accounted for by . 

ATI SIRS Variables 



.01 



Positive 
Consequences 



(-) 



b 



Frequency of 
Correct Answers 



(+ 



.02 



.03 



.03 
.02 
.11 

.08 

.11 

.08 
.08 



4 



b 



The passage score at time 1 was used to control for entering achievement. * ' i 

'Gain in words read per minute from the third grade passages frorffme 1 (October) to time 3 (May), 

'The proportion of the residual variance accounted for by the variable listed in Column 2, where 
residual variance refers to the variance remaining, In the post-achievement measure after entering 
achievement at time 1. , 

j The proportion of the residual variance accounted for by all SIRS variables after accounting for . 
pre-achievement. v 



Appendix A 

Structure of Instruction Rating Scale (SIRS) 
School: Student: 



Date: Teacher 



Observer: Number of Students in Group:_ 

Number of observations prior to. rating: 

Time observation begins \ \ Time observation ends: 

Time allocated to reading instruction per day: 

Currirulum used for instruction: Publisher 



( 



Series Level_ \j 

Instructions 

Circle the number that accurately reflects your rating for each 

variable. Only one* number may be circled per variable. If you are 

unable to evaluate- a certain Variable, mark N/A (not applicable) next 

to the left-hand column. • 

1. Instructional Grouping. 12 3 4 5 

2. Teacher-directed Learning 12 3^4 5 

3. Active Academic Responding ,1 2 3 4 5 
4/ .Demonstration/Prompting 1. 2 3 4 5 

5. Controlled Practice 1 2-34^5 

6. Frequency of ^Correct Answers 1 2 3 4 5 

7. Independent Practice , 1 2 3 4 5 

8. Corrections" :.l 2 3.4 5 

9. ^Positive Consequences 1 2 3 4 5 

10. Pacing 12 3 4 5 

.11. Oral Practice on Outcome 

Behavior 1 2 3 4 5 

12. Silent Practice on Outcome t 

Behavior 1 2 3 4 5 



-2 



SIRS 



Operational Defini tions Codebook 



Ins true ti onal Grouping 

5 - 90% or mo^e of the instruction this student receives from the 
teacher is on an individual basis. 

1 - 10% or less of the instruction this student receives from the 
teacher is on an individual basis. 'x 

Teacher-Directed Learning 

5 - Student's instruction is extremely organized^ businessl i ke^ 
and teacher is firm in direction and control of activities. 
For example, student is presented with' questions , student 
has material to cover, etc,/ 

1 - Student's instruction is casually organized and very spon- 
taneous. Teacher is not committed to having the student work 
on a particular set of material. Instructional materials do 
not determine what activities student engages in and the les- 
sons change according to problems or mood of this student. 

Active Academic Responding 

5 - The student is actively practicing the academic skills to be 
learned more than 75% of the time observed'. Specifically, the 
student is engaged in oral or written responding to teacher 
questions or written material, e.g., reading aloud, answering 
questions, writing, or computing. Student rarely is involved 
in non-academic conversations with teacher or other students 
Attending to the lesson without responding, such as sitting, 
looking, listening, and/or following ^long in a book does not 
apply. 'The student must make an active, written or oral 
response. 

1 - The student is actively practicing the skills to be learned 
less than 10% of the time observed.' Ins tructional lessons 
may be interrupted or shortened to include "process" and other 
$ non-academic activities, e.g., clarifying feelings, opinions, 
and working on arts and crafts. 

Demonstration and Prompting 

5 - Appropriate steps of the desired behavior to be performed are 
* demons trated for the student. Student is given an opportunity 
to practice the step(s) as teacher provides prompts for correct 
behavior that approximates or achives desired response. 

1 - Teacher attempts to teach the student a behavior without using 
demonstration and prompting techniques. 
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5. Controlled Practice 



5 -j. Student's practice of material is actively controlled by 
"teacher who frequently* asks questions to clarify that the 
student understands what has just been demonstrated. Ques- 
tions are convergent ( single factual answer ) and the stu- 
dent's answers consistently follow the questions and are 
given teacher feedback. * 

1 - Student is rarely questioned by teacher following demonstra- 
tion of new materials. Questions are more divergent (open- 
ended, several interpretations) than convergent (single factual 
answer). Student's response is not consistently followed- by 
teacher feedback. The type<of questions are such that several 
answers are acceptable, i.e., questions are abstract or am- 
biguous . * 

r '^mples : 

If duri n oral, reading session:- 

a) the teacher frequently attempts to clarify the material with 
convergent questions ("what color hat was John wearing*"), a 
5 would be recorded. 



\ 



b) -the teacher asks few questions, most of which are divergent^ 

("What do you think this means?"), a 1 would be recorded. ? - j 

c) the teacher asks few convergent questions or ' many di verqent 
• questions", the appropriate rating would be a 3>, 

o 

6. Frequency of Correct Answers 

5 - Academic lessons are conducted in sueh a way that the difficulty 
of the material allows the student to -achieve mean accuracy '< 
of 80% -or higher. 

1,,- Academic material is difficult for student , component steps 
are large or unsequenced, and "mean accuracy for student is 
less than 55%. • ■ / 

(Note: If the student has, no opportunity for oral or written response 
during the observational period, it§m 6 would be rajted* N/A - 
not applicable, while items 3 and 5 would most likely be 
rated 1). 

7. Independent Practice 

5 - When engaged in independent seatwork, the student frequently is 
monitored by the teacher who assists, clarifies, and praises 
the student for academic engaged tasks. 

(Note: 'Independent seatwork 'is defined here as a student working on an 
assigned task for at least 5 minutes. .Llf no such 5-minute 
•block of tire is observed, Item 7'is r^ted N/A].) 



1 - When student is engaged in academic seat-work activities, little 
attention is given by teacher who directs seat-work activities 
from a'distance or engages in work separate from the assigned 
seat work. Teacher is generally not helpful or supportive to 
^Student during independent practice time. * 

8. Corrections - - : K 
s 

5 - The student's errors are consistently corrected by the teacher. 
When the student either does not respond, responds incorrectly, 
or does not respond in unison if the activity is group directed 
and requires such responding, the teacher will systematically 
. attempt to correct the student by asking a simpler question, re- 
fo.c using student's attention to el ici t correct response from the 
student or provide general rules by which to determine the 
correct answer 90% or more of the time. 

1 - Students errors are rarely and inconsistently corrected by the 
teacher. The student responses are not systematically corrected 
Student's errors are corrected 50% or less of the time. 

For example: In oral reading this includes teacher correction of skips 
and mispronunciations, or help in sounding out hesitations 

9. Positive Consequences 

5 - Positive events (tokens, points, activities, etc.) are given to 
the student when performing the desired behavior.. When learning 
a new skill the student receives positive-consequence for 
approximations of khe desired behavior. Consequences are con- 
sistently received during academic training time. Praise and 
compliments, e.g., "good working, nice jbb.J' ire not included 
in this definition. 



1 - Student rarely receives posi ti ve consequences for academic work 
When student receives consequences they\usually are for social 
behavior, rather than for behaviors occurring under systematic, 
academic training. 



10. Pacing 



5 -...The pace of the lesson is rapid, provi di ng ificiny opportunities 
for 'response by the student. As a result, attention is high 
and off-task behavior is low. j 

1 The pace of the lesson is slotf* and the student's rate of 
responding is low. Lesson fprmbt frequently varies, is not 
highly structured, and student attention may be low. 



11.; Oral Practice on Outcome Behavior 

5 - Student reads aloud from context nearly all the time (85-1 00% 
or 12-15 min. of a 15 min. observation). 

1 - Student does not read aloud during the observation {0% of the 
time). 

(Note: Reading aloud for measurement purposes should not be considered 
when rating this variabl e . Reading in context is defined as 
reading phrases, sentences, paragraphs, or story selections*) 



Examples: 

If the student is reading isolated words nearly the entire time, 
the appropriate rating is a 3. 

If the student is reading aloud' v from a ; text about half the time, 
a 3 would be recorded. ■ • 

12. Silen t Practice on Outcome Behavior 

t 

5 - S tjjdent reads silently from context nearly all the time (85-100% 
, or 12-15 min. of a 15 min. observation). 

1 - Student does not read silently during the observation {0% of 
the time.)-. 

(Note: Reading in context is defined as, the same as #11. The examples 
of #11 are the same for #12, with silent reading.) 
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